(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
Internationa] Bureau 

(43) International Publication Date 
I 28 February 2002 (28.02.2002) 




PCT 



i sill iBimi ii mill urn ieii i ii m hid iiiii iihi inn mi ii ii id iiii mt mi 

(10) International Publication Number 

WO 02/17642 A2 



(51) International Patent Classification 7 : 



(21) International Application Number: PCT/US01/41894 

(22) International Filing Date: 27 August 2001 (27.08.2001) 

(25) Filing Language: English 

(26) Publication Language: English 



H04N 7/24 (71) Applicant (for all designated States except US): INTEL- 
LOCITY USA INC. [US/US]; 1400 Market Street, Den- 
ver, CO 80202 (US). 



(30) Priority Data: 

60/227,930 
60/227,918 
09/935,492 



25 August 2000 (25.08.2000) US 
25 August 2000 (25.08.2000) US 
23 August 2001 (23.08.2001) US 



(63) Related by continuation (CON) or continuation-in-part 
(C1P) to earlier application: 

US 09/935,492 (CON) 

Filed on 23 August 2001 (23.08.2001) 



(72) Inventor; and 

(75) Inventor/Applicant (for US only): MARKEL, Steven, 

O. [US/US); 3031 E. Wyecliff Way, Highlands Ranch, CO 
80126 (US). 

(74) Agents: GALLENSON, Mavis, S. et ah; Ladas & Parry, 
5670 Wilshire Boulevard, Suite 2100, Los Angeles, CA 
90036 (US). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, FI, GB, GD, GE, GH, 
GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT r LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, PH, PL, PT, RO, RU, SD, SE, SG, SI, 

[Continued on next page] 



(54) Title: TELEVISION ENHANCEMENT 



Set Top Box Models 



< 

o 



100 



Mitsubishi WB-2001 
Philips Magnavox MAT972 
Philips Magnavox MAT976 
RCARW2110 
Sony INT-W250 
Sony INT-W200 



= HTML Support 



HTML LO 
HTML 2.0 
HTML 3.2 
Frames Compatibility 
JavaScript 12 



102 



104 



Image Support 



GIF89a animation 
JPEG 

Progressive JPEG 
PNG 

TIFF-G3 Fax in Email 
X bitmap 

Macromedia™ Flash 1.0 
Macromedia™ Flash 2.0 
Macromedia™ Flash 3.0 
Transaction 



(57) Abstract: A system and method 
for creating a platform independent 
enhancement file for television 
employs a web based editor with 
local functions for repositioning 
and sizing of display able elements. 
Elements comprise text, graphics, 
images, or imported HTML files. 
Trigger information associated 
with elements controls the time and 
actions performed when rendering 
the displayable elements. A 
database comprises data representing 
elements, element attributes, trigger 
information and project information. 
A file generation process queries 
the database and produces a platform 
independent XML compatible script 
file. The script file may be parsed 
and the resultant HTML/Javascript 
file may be previewed employing 
a web browser. The script file may 
be parsed with other tools to provide 
HTML files for specific platforms 
without modification of the script 
file. 



BNSDOCID: <WO 0217642A2J_> 



WO 02/17642 A2 11111II1M1III1MI1IIII1III111I1111 



SK, SL, TJ, TM, TR, TT, TZ, UA, UG, US, UZ, VN, YU, 
ZA,ZW. 

(84) Designated States (regional)', ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, 
IT, LU, MC, NL, FT, SE, TR), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA, GN, GQ, GW, ML, MR, NB, SN, TD, 
TG). 



Published: 

— without international search report and to be republished 
upon receipt of that report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



RNRnOCIO <WO 021 7642 A2 1 > 



WO 02/17642 



PCT/US01/41894 

TELEVISION ENHANCEMENT 



5 Cross Reference to Related Applications 

This application is based upon and claims priority of United States provisional 
application serial number 60/227,930, entitled "SYSTEM AND METHOD FOR WEB 
BASED ENHANCED INTERACTIVE TELEVISION CONTENT PAGE LAYOUT; 

10 filed August 25, 2000 by Steve a Markel; United States provisional application serial 
number 60/227,063, entitled "A DATA DRIVEN SYSTEM AND METHOD FOR 
DISTRIBUTION OF INTERACTIVE CONTENT TO MULTIPLE TARGETED 
PRESENTATION PLATFORMS' 1 filed Aufeust 21 , 2000 by Steven O. Marked and 
United States provisional application serial number 60/227,918, entitled "METHOD OF 

15 ENHANCING STREAMING MEDIA CONTENT' filed August 25, 2000 by Steven O. 
Markel, the entire disclosure of which is herein specifically incorporated by reference for 
all that it discloses and teaches. 

Background 

a. Field 

The present disclosure relates to interactive and enhanced television and, more 
particularly, to a method and system of creating enhancement content that may be displayed 
in conjunction with a television program. This disclosure discusses systems and methods for 
web based enhanced interactive television content page layout. 

25 

b. Description of the Background 

A television program may be accompanied by additional information employed to 
enhance the program or to provide viewer interaction. Enhancements have historically 
included closed captioning and multilingual support. Advances, in networking, computer 
30 systems, and video production have increased the number and types of enhancements that 
may be provided with a program or advertisement. Enhancements may include stock 
updates, news stories, Internet links, weather forecasts, bulletins, statistics, trivia, and 
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other information. For example, a football game may include icons allowing viewing of 
team players, statistics, trivia and other information such as upcoming games. Further, the 
advent of set-top-boxes, as may be used in cable and satellite television systems, aUows 
enhancement information to be presented in new ways, such as screen overlays and in 
5 windows, for example. 

Enhanced television content may employ a combination of HTML (hypertext 
markup language), JavaScript, Java and other formats common to Internet page display. 
An enhanced display may comprise text, icons, graphics and images placed at locations 
on or in proximity to the television image. To produce an enhanced display, an author 

10 must create a file identifying each displayed element (such as text, icons, graphics and 
images),, the location where each element is displayed, and the starting time a duration for 
which an element or group of elements is displayed- Previous methods employed .to enter 
parameters required to generate and position the elements comprising the layout of 
enhanced pages have involved manually entry. The resultant application program may 

15 require compilation and execution in order to view the resultant image or images. This 
maybe an iterative process, requiring multiple compilations before a desired result is 
obtained. Such iterative processes may be costly and time consuming- 

Additionally, due to the numerous differences between presentation platforms, 
such as set top boxes, satellite receivers, computers, or interactive televisions, content 

20 providers have historically been required to target a specific platfoim in the development 
of an application. In order to provide support for each additional platform, the interactive 
content provider must introduce potentially significant modifications to the existing 
application, resulting in the ongoing maintenance of multiple code bases and adding to 
the time and cost required to produce enhanced page layouts for multiple platforms. 

25 Further, web page design tools, such as FrontPage™, DreamWeaver™, and others, do 
not support administrative capabilities nor do they support databases. Therefore a new 
method of creating enhanced content that allows utilization across multiple platforms and 
provides an accurate preview of enhancements is needed. 
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Summary. of the Invention 

The present invention overcomes the disadvantages and limitations of the prior art 
by providing an interactive television enhancement authoring method and system 
5 allowing simple development of text, graphics, and image display, emulation of the 
enhancements, and production of a platform independent enhancement file, called 
iTVML, that may be parsed, using a publisher tool (such as iTV Publisher from 
Intellocity), to create interactive television enhanced content files specific to particular 
platform such as WEBTV™ aOLTVtm or ot b er platforms. An authoring program 
10 communicates with a web browser such that the present invention may be utilized locally 
or across a network. 

The invention may therefore comprise a method for creating a television 
presentation enhancement comprising: defining a window in a graphical user interface; 
placing a displayable element at a position in the window; defining a time when the 
5 displayable element may be rendered; employing a database to store information 
describing the displayable element and the time; creating a platform independent 
television enhancement file containing information related to the displayable element and 
the time; parsing the platform independent television enhancement file to produce an 
HTML file; and viewing the HTML file. 

Software downloaded to the browser provides 'drag and drop' and resizing editing 
functions at the user's browser, eliminating delays that may be incurred due network 
latencies and server workload if these functions were implemented at the server The 
invention comprises a number of user screens that may be accessed through URLs that 
provide administrative, project, page, layout, trigger, emulation, and iTVML export. 
Administrative functions provide user accounts, login, and tutorials. The project and page 
screens provide access to projects and specific enhancement pages with the projects. The 
layout page provides an easy to use, user-friendly graphical editing environment where 
elements such as text, graphics, images, and executable routines may be placed on a 
video display area (canvas) and may be moved and sized. The trigger functions provide 
synchronization of the presentation of enhancements to a specified event, such as frame 
time or presentation duration, for example. The emulation function generates an iTVML 
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file and parses the file for web browser presentation, providing an accurate representation 
of the enhancement if viewed on a television. The iTVML export function provides 
generation and saving of an iTVML file. 

The invention may therefore further comprise a system for creating television 
5 enhancements comprising: a graphical user interface implemented in a web browser 

environment; a rectangular area defined in the browser environment; a user interface that 
places a displayable element in the rectangular area; a user interface that specifies a time 
at which the displayable element maybe rendered; a database that stores information 
associated with the displayable element and information associated with the time; a 

10 pointing device; and a user interface that initiates generation of an XML file containing 
tags for the information associated with the displayable element and the information 
associated with the time. 

Advantageously, the present invention provides an efficient, easy to use system 
and method for creating television enhancements that produces a platform independent 

15 enhancement file. The enhancement file maybe emulated using the invention to preview 
the appearance of the enhancements. The enhancement file may be parsed by other tools 
to produce platform dependent enhancement files without re-editing, resulting in lower 
costs to support a range of presentation platforms, and uniformity in the content of the 
enhancements provided. 

20 

Description of the Figures 

In the figures, 

Figure 1 depicts html and image support for a group of commercially available set 
25 top box products- 
Figure 2 depicts the software environment of the present invention. 
Figure 3 depicts software components of the authoring program. 
Figure 4 is a screen depiction of the administration module configured for user 

login. 

30 Figure 5 depicts a projects screen. 

Figure 6 depicts a pages screen. 



4 



WO 02/17642 



PCT/US01/41894 



Figure 7 depicts a layout page screen. 
Figure 8 depicts a triggers screen. 
Figure 9 depicts an emulation screen. 
Figure 10 depicts an XML screen. 
5 Figure 1 1 is a flowchart of a method for selecting an element on the canvas of the 

layout screen. 

Figure 12 is a flowchart of a method for moving and/or resizing an element on the 

canvas of the layout screen- 
Figure 13 depicts an iTVML generation process. 
10 Figure 14 depicts a process for creating an XML compliant string containing 

header information. 

Figure 15 depicts a process for creating an XML compliant content string. 
Figure 16 depicts a process for creating an XML compliant timeline string. 

15 

Detailed Description of the Invention 

Figure 1 depicts HTML and image support for a group of commercially available 
set top box products- Set top box models 100 provide HTML support 102 and image 

20 support 104. HTML support 102 lists support for html 1,0, 2.0, and 3.2 versions. A 
limitation of HTML is that some versions lack downward compatibility. For example, 
HTML versions 4 and higher do not support all the tags of HTML 3.2. Figure 1 serves to 
illustrate that an HTML based author for creating enhanced content would not be able to 
support a wide range of target platforms. The present invention overcomes the 

25 disadvantages of HTML based authoring by providing an authoring tool that generates an 
extended XML file, called iTVML, that may be parsed using XSL scripts for each 
platform type to produce HTML code and Javascripts suitable for each platform. Through 
the use of the iTVML author of the present invention, enhancements need only be 
authored once, and then XSL scripts specific to each set top box, or types of set top boxes 

30 may be applied > thereby preserving the investment in authoring by not requiring changes 
for each platform. 
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Figure 2 depicts the software environment of the present invention. Authoring 
components 200 comprise database 202 and authoring program 204. Rendering 
component 206 comprises a display program 208 that may be viewed employing a 
browser display utility such as Microsoft Internet Explorer. Database 202 may comprise 
5 Microsoft ADO (ActiveX Data Objects) from Microsoft Corporation. ActiveX is a set of 
programming rules that allows the output of other applications, such as spreadsheets and 
word processors for example, to be viewed in web browser formats. Authoring program 
204 may employ a programming environment such as VBScript Visual Basic Scripting 
Edition (most commonly referred to as VBScript) is a subset of Microsoft Visual Basic. 

10 Display program 208 may comprise Javascript components. JavaScript is a scripting 
language that allows lines of Java code to be inserted into HTML scripts, Java is an 
object oriented programming language created by Sun Microsystems. Java is a . device 
independent language, meaning that programs compiled in Java can be run on any 
computer. Java programs can be run as a free-standing application or as an applet placed 

15 on a web page. Applets written in Java may be served from a web site and executed on a 
client computer- For example, a JavaScript function may be employed to verify that users 
enter valid information into a form requesting a user ID and password. Without any 
network transmission, an HTML page with embedded JavaScript can interpret the entered 
text and alert the user with a message dialog if the input is invalid. Further, JavaScript 

20 statements embedded in an HTML page can recognize and respond to user events such as 
mouse clicks, form input, and page navigation. Such response may comprise execution of 
an applet, communication with a browser plug-in, or other action. 

Figure 3 depicts components of authoring program 204 shown in figure 2, 
Authoring program 300 comprises administration module 302, projects module 304, 

25 pages module 306, layout module 308, triggers module 3 10, emulation module 3 12 and 
export module 314. Each of the aforementioned modules maybe accessed employing a 
browser and a URL Universal Resource Locator (URL) identifying the location of the 
HTML and Javascript code that maybe employed to produce each page. 

Figure 4 is a screen depiction of the administration module configured for user 

30 login. Administration module 400 is accessed via URL 402 . Administration module 400 
may provide entry of user name 404 and user password 406. The user may select login 
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button 408, new user button 410, or tutorial button 412 to access functions of this 
module. New user button 410 allows an account to be established for a new user. Tutorial 
button 412 may be employed to receive information concerning use of the present 
invention. Once a user has entered a valid username and password, a screen 
5 representative of one of the other modules depicted in figure 3 may be displayed. The 
user may navigate between modules by selecting navigation buttons located in each 
screen. 

Figure 5 depicts a projects screen. Projects screen 500 may be accessed through 
URL 502. Projects screen 500 comprises project selector 504, project information and 
10 control area 506 and navigation buttons 508. Project selector 504 allows the user to select 
from existing projects. Control area 506 comprises project information and control 
buttons. Project information may comprise a project name, status information to indicate 
the state of completion of a project, author name, client, duration of the enhancement, the 
number of frames for which the enhancement is displayed > the start frame, the start page, 

15 the video file to which the enhancement may be applied, return bandwidth that indicates . 
the rate at which an enhancement may be delivered, a return connect time indicating 
latency in establishing a connection, the TV format employed (such as NTS'C or PAL), 
notes concerning the enhancement, a file to which the enhancement may be published, 
and email addresses for XML and HTML code. Control area 506 may comprise buttons 

20 that allow selection of a new project (and saving of the current project), deletion of a 
project, publishing of an iTVML .file and publishing of the project. Navigation buttons 
50S allow the user to switch between screens of the invention. When a user navigates 
from the projects screen to another screen, information associated with the projects 
screen may be saved to a database. 

25 Figure 6 depicts a pages screen. For each project there may be one or more pages. 

Pages screen 600 may be accessed through URL 602. Project 606 shows the project 
name. Page select 604 provides a pull down menu for selection of existing pages. Page 
name 608 shows the name of a selected page, or the name given to anew page or a copy 
of another page, A new page may be selected through control burtons 610 that allow a 

30 page to be deleted, copied, or for a new page to be created. Navigation buttons 612 allow 
the user to switch between screens of the invention. 
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Figure 7 depicts a layout page screen. Layout screen 700 maybe accessed through 
URL 702. Project selector 704 provides selection of a project Page selector 706 allows 
selection of a page in the project. The layout screen further comprises a canvas area 708 
that may contain a video frame and enhancement elements, plus properties box 710. 
5 Canvas area 708 may be implemented as a window having a width that is a multiple of 
the pixel width of the video image, eliminating rescaling operations. Properties box 710 
provides selection of enhancement elements and parameters associated with those 
elements. Properties box 710 comprises 3 number of user input areas that are described 
hereafter with reference to figure 7. Display safe area check box 712 provides a reduced 

10 size canvas area such that elements on the canvas will not be obscured in some monitors. 
Element selection menu 714 provides user selection of text, graphic, and image elements, 
and instance selector 716 allows selection of an instance of the element Further> element 
selection menu 714 may be employed to import HTML and Javascript routines created 
with the present invention or other tools such as HTML authoring software. The 'Add' 

15 button of element selection menu 714 may be employed to place an element on canvas 
708 once an element and instance have been selected. The selected choices are shown in 
element name 718 and element type 720. Some elements include user specified values, 
such as text Such values may be entered through value entry 722. The position of an 
element may be entered using position window 724, or the element may be positioned 

20 using a mouse or other pointing device as shall be described later. The size of an element 
may be specified through size entry 726, or element size may be configured using a 
mouse or pointing device as shall also be described later. Elements may be placed to 
appear on top of other elements or behind other elements through a Z order value 
accessed through Z order control 728. The order may be specified in an order box, or the 

25 order of a selected element may be adjusted using front and back buttons. The visibility, 
of an element may be selected through visibility control 730. An element may also serve 
as a link to other information, web pages, or executable programs. The link may comprise 
a local address, a web address/URL, or other address. A link associated with an element 
may be specified through link control 732. The font employed in text elements may be 

30 specified through font control 734. The color of text and graphics may be selected 

through color control 736. Flush (placing of an element at the edge of the canvas) maybe 
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selected through flush control 738. A selected element may be deleted by selecting delete 
button 740. Deletion of a selected element may also be performed via keyboard entry. 
Navigation burtons 742 allow the user to switch between screens of the invention. 

Figure 8 depicts a triggers screen. Triggers are employed to synchronize the 
5 rendering of enhancements with an event, such as a frame number or display time, for 
example. Triggers screen 800 maybe accessed through URL 802, Project select window 
804 allows selection of a project and displays the project name. Page selection window 
806 allows selection of a page within the project and displays the page name: Trigger 
controls 808 provide specification of a trigger name, the time at which the trigger may 
10 execute, the action to be taken when the trigger time occurs, the element, and a trigger 
list For example, at 5 seconds, the text of an element may be changed to provide a 
welcome message. Triggers may provide a monitoring function downloaded to platform, 
such as a set top box or interactive television, for example, that then monitors a television 
program for a specified event. When the specified event occurs, an enhancement -file 
15 comprising HTML or HTML and Javascript may be executed from platform memory, or 
may be retrieved using a transport method wherein the downloaded monitoring includes a 
URL from which the enhancement file may be accessed. 

Figure 9 depicts an emulation screen. Emulation screen 900 maybe accessed 
through URL 902. The emulation screen may be employed to display television images- 
20 and enhancements as they would appear on a television or other video receiving 

equipment The emulation process includes generation of an iTVML file from database 
information, parses the iTVML file with an XSL parser configured for web browser 
display, producing.an HTML/Javascript output that is then provided to the browser. 
Generation of iTVML files is described in figures 13 through 16. 
25 Figure 10 depicts an XML screen, XML screen 1000 maybe accessed through 

URL 1002. Display area 1004 of XML screen 1000 provides a listing of the iTVML code 
generated. 

Operationally, a user fust opens the administration page of the present invention 
by employing a web browser accessing the URL of the administration page. The user 
30 may then log into the system y establish a new account, or vie^v a tutorial. Once a user has 
provided a valid usemame and password,.a projects page may be presented (Steve-is this 

9 
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how navigation is set up?). From the projects page the user may select a project to edit, 
view, publish or delete, or a new project may be started. If a new project is started, the 
user enters project information (as described in figure 5), including a video file and start 
frame information. The user may then select a navigation button on the lower portion of 
5 the screen to move to the pages screen. Using the pages screen, the user may select an 
existing page, copy an exiting page, delete an exiting page, or create a new page. The 
project name selected in the projects screen is displayed in the project window of the 
pages screen. A page name may be assigned to the new page, after which the user may 
navigate to the layout screen. The layout screen comprises a canvas area in which the 

10 video frame, identified in the projects screen, may be displayed. The properties box of the 
layout screen may be employed to select and position graphic, text, image, and imported 
executable elements within the canvas area. Advantageously, the present invention 
includes 'drag and drop* and 'resize' functions implemented at the user's browser. This 
provides the convenience and productivity of mouse (or other input device) driven, editing 

1 5 without incurring delays that may result from network latencies or server workload. The 
'drag and drop' and 'resize' functions are implemented as a Javascript downloaded to the 
user's browser as part of the layout screen. Flowcharts of the implementation of 'drag and 
drop' and 'resize* functions are presented in figures 1 1 and 12. Appendix A provides an 
code listing for a Javascript implementation with numerical references to the flowchart 

20 functions. 

Figure 1 1 is a flowchart of a method for selecting an element on the canvas of the 
layout screen- Mouse select process 1100 begins with a mousedown (button activation) at 
step 1 1 02. Stepl 1 04 determines if the mouse position is inside the canvas when the 
button was activated. If the mouse position is outside the canvas area, mouse data is 

25 passed to other programs such as may be employed to select items within the properties 
box or other items contained in the layout screen. If the mouse position is inside the 
canvas, step 1 106 determines if the position is inside the knobs of an element Knobs are 
visual elements, such as small rectangles, for example, that are displayed at the edges of 
an element when selected. If the mouse is inside a knob, stepl 108 removes the knobs and 

30 the process ends at step 1 1 1 0. If step 1 1 06 determines that the mouse position is not 
inside a knob, step 1 12 determines if the mouse position is inside an element. If the 

10 
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mouse position is not inside an element, the process ends at step 1114, If step 1 112 
determines that the mouse position is inside an element, step 1116 obtains the element's x 
and y position, height, and width. Step 1118 then determines if the user selected a - 
different element. If a different element was selected, step 1 120 deselects the previous 
5 selection and the process sends at step 1 122, If the user did not select a difference 
element, the new element is selected at step 1124 and the process ends at step 1126. 

Having selected an element on the canvas of the layout screen using the process 
of figure 1 1 , a user may now move or resize the elemenL Figure 1 2 is a flowchart, of a - 
method for moving and/or resizing an element on the canvas of the layout screen. Move 
10 and resize process 1200 begins with step 1202 where a mousemove event is received. A 
mouse move event occurs when a mouse button is activated while the mouse is 
positioned over an element and the mouse is moved. Step 1204 determines if the mouse is 
positioned over a resize laiob displayed in conjunction with a selected element If step 
1204 determines that the mouse position does not correspond to a knob, step 1206 moves 

15 the element using mouse movement information. The size of the element is not altered 
and processing ends at step 1208. If the position of the mouse corresponds to a knob of 
the element, step 1210 checks if the knob corresponds to a west (left side) knob. If the 
west knob is selected, step 1212 checks if the west knob is a lower left knob. If the knob 
is not the lower left knob, step 1214 resizes the element by changing the left coordinates 

20 of the element and keeping the right edge position and height of .the element unchanged. 
Processing then ends at step 1216. If step 1212 determines that a lower left knob is 
selected, step 1218 adjusts the height and width of the element, maintaining the aspect 
ratio of the element and the position of the upper right corner of the element. Processing 
then ends at step 1216. If step 1210 determines that the west knob is not selected, step 

25 1220 checks if the east knob (right side) was selected. If the east knob is selected,- step 
1222 checks if the east knob is an upper right knob. If the knob is not an upper right 
knob, step 1224 resizes the element by changing the right coordinates of the element and 
keeping the left edge position and height of the element unchanged. Processing then ends 
at step 1226. If step 1222 determines that an upper right knob is selected, stepl228 

30 adjusts the height and width of the element, mainiaining the aspect ratio of the element 
and the position of the lower left comer of the element. Processing then ends at step 

U 
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1226. If step 1220 determines that an east knob is not selected, step 1230 checks if a 
north knob is selected. If a north knob is selected, step 1232 checks if the upper left knob 
was selected. If the upper left knob was not selected, step 1234 resizes rhe element by 
changing the top coordinates and keeping the bottom coordinates and width of the 
5 element unchanged. Processing then ends at step 1236- If step 1232 determines that the 
upper left knob was selected, step 1238 adjusts the height and width of the element while 
maintaining the aspect ratio of the element and the position of the bottom right 
coordinate. Processing then ends at step 1236. If step 1230 determines that a north knob 
was not selected, step 1240 checks if a lower right knob was selected. If a lower right 

10 knob was not selected, step 1242 adjusts the height of the element, keep the width and top 
coordinates unchanged. Processing then ends at step 1244. If step 1240 determines that 
the knob is a lower right knob, step 1246 adjusts the height and width of the element* 
while maintaining the aspect ratio of the element and the position of the top left 
coordinate. Processing then ends at step 1244. Appendix A lists code to implement the 

15 'drag and drop* and 'resize 1 functions described in figure 1 land figurel2. 

After the user has placed elements on the canvas, positioned them at desired 
locations and sized them to desired sizes, the user may select the emulation screen to 
view the appearance of the enhanced frame or sequence of frames. Selecting the emulate 
function from the navigation buttons performs the following functions. First, the database 

20 entries associated with the current layout are accessed and a flat file of extended XML, 
called iTVML, is produced. The iTVML file is then passed through an emulation XSL 
parser that converts the iTVML into HTML and Javascript that is then sent to the user's 
browser to produce the emulation display. 

The iTVML file is an XML compliant file with tags for the information contained 

25 in the project, layout, and triggers screens. The iTVML file is produced by retrieving 

information from the database, comparing each entry to a table of entries for that screen, 
and 'encapsulating 1 the entries with XML compliant formatting. 

Figure 13 depicts an iTVML generation process. The iTVML process 1300 starts 
at step!302. At step 1304, the database is queried using the project ED. Step 1306 

30 determines if any records are retrieved. If no records corresponding to the project ID are 
found, the process ends at step 1 308. If a record corresponding to the project ID is 
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retrieved, step 1310 sets the iTVML comments to string. Step 1312 appends an iTVML 
header to the string. The iTVML header may be generated as described in figure 14. 
Continuing with figure 13, step 1314 appends a library opening to the string. At step 
1 3 1 6, a resource tag identifying the asset directory is appended to the string. At step 1318 
5 a library closing is appended to the string. At step 1320 content information is appended 
to the string. Content information may be generated through the process described in 
figure 15. Continuing with figure 13, step 1322 appends timeline information to the 
string. Timeline information may be generated through a process described in figure 16, 
Continuing with figure 13, step 1 324 terminates the string and the process ends at step 

1 0 1326. The iTVML process 1300 may be viewed as aprocess that assembles (in a string 
format compliant with XML), information defining where assets maybe located, plus 
appends infoimation from the projects, layout and triggers screens. 

Figure 14 depicts a process for creating an XML compliant string containing 
header information. Header process 1400 begins at step 1402. At stepl 404, an opening 

15 tag, such as '<HEAD>', is appended to the string. At step 1406 the current data and. time 
with an iTVML current date and time tag are appended to the string. At step 1408, the 
author name with an iTVML author-name tag is appended to the string. At step 1410, . 
notes are extracted from the database and are appended to the string with an iTVML 
notes tag. At step 1412, the name of the project is extracted from the database and is 

20 appended to the string with an iTVML project-name tag. At step 1414, the project ID is 
extracted form the database and appended to the string with an iTVML project-ID tag. At 
step 141 6„ the date the project was created is extracted from the database and appended to 
the string with an iTVML created-date tag. At step 1418, the data the project expires is 
extracted form the database and appended to the string with an iTVML project-expires 

25 tag. At step 1420, the date the project was last published is extracted from the database 
and appended to the string with an iTVML last-published tag. At step 1422, the current 
project status is extracted from the database and appended to the string with an iTVML 
project-status lag. At step 1424, the project-company is extracted form the database and 
appended to the string with an iTVML project company tag. At step 1426 the video 

30 source is extracted form the database and appended to the string with an iTVML video- 
source tag. At step 1428, a query is performed against the transport table based on the 
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project ID. If no transport records are found, step 1440 appends a closing tag, such as 
V<HEAD> r , to the string and the process ends at step 1442. If step 1430 retrieves a 
transport record, step 1432 extracts transport A bandwidth from the record, appends the 
bandwidth information to the string with an iTVML transport-bandwidth tag. Step 1434 
5 extracts the transport A return path bandwidth from the record and appends the return 
path bandwidth to the string with an iTVML retum-bandwidth tag. Step 1436 extracts the 
transport A return path connect time from the record and appends the information to the 
string with an iTVML connect-tiroe tag. Step 1438 extracts the transport A base URL 
from the record and appends the URL to the string with an iTVML base-URL tag. Step 

10 1440 then appends a closing tag, such as 7<HEAE»', to the string and the process ends at 
step 1442. Header process 1400 maybe viewed as a process that assembles (in a string 
format compliant with XML), information contained in the projects screen. 

Figure 15 depicts a process for creating an XML compliant content string- 
Content process 1500 starts at step 1502- At step 1504, an opening tag, such as 

15 r <CONTENT>\ is appended to the string. At step 1506, the database is queried for 
elements corresponding to the project ID. Step 1 508 checks for element records. If no 
element records are found, step 1510 appends a closing flag, such as 7<CONTENT>\ to 
the string and the process ends at step 1512- If step 1508 finds a record, step 1514 
appends the record information to the string' searches a list of element types and appends 

20 an iTVML tag for the element type. Step 1516 then selects the next record and processing 
continues at step 1508, If no records remain, step 1510 appends a closing flag, such as 
V<CONTENT>\ to the string and the process ends at step 1512. 

Figure 16 depicts a process for creating an XML compliant timeline string. 
Timeline process 1600 begins at step 1602. At step 1604 an opening tag, such as 

25 , <TIMELINE>^ is appended xo the string. At step 1606, frame length is extracted from 
the database and appended to the string. At step 1608, frames per second is extracted 
from the database and appended to the string. At step 1610, a 'uses drop frame' flag is 
extracted from the database and appended to the string. At step 1612, start time is 
extracted form the database and appended to the string. At step 1614, life span is 

30 extracted from the database and appended to the string. At step 1616, a triggers table is 
queried using the project ID. Step 1618 checks if trigger records exist. If no trigger 
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records exist> step 1624 appends a closing tag, such as , </TlME^^lE> , , and processing 
ends at step 1 626. If step 1618 finds a trigger record, step 1 620 creates a trigger tag with 
the time* element affected, and function call. Step 1622 then moves to the next element- 
If step 1618 determines that no more elements exist, step 1624 appends a closing tag, 
5 such as ^/TIMEIJNE^, and processing ends at step 1626. 

Figures 13, 14, 15, and 16, depict a method in which database entries from the 
project, layout, and triggers screens may be processed to produce an iTVML file. 
Appendix B provides an example of the form and content of the iTVML file and 
illustrates the present invention's placement of database information within XML 

I o compliant tags. Once an iTVML file has been created, it may be parsed using industry 
standard XSL (Extensible Stylesheet Language) methods to produce HTML and 
Javascript that may be run on an industry standard web browser and media player such as 
Microsoft Internet Explorer and Windows Media Player, both from Microsoft 
Corporation. Additional information regarding XSL may be obtained from the following 

15 books; 



Title; Professional XSL 
Authors: Kurt Cagle et al. 
Publisher; Wrox Press Inc; 
20 ISBN; 1861003579 

Title; XSL Companion, The 
Author: Neil Bradley 
Publisher: Addison-Wesley Pub Co; 
25 ISBN: 0201674874 

The iTVML file may also be parsed using a tool called iTV Publisher, that is the subject 
of a co pending patent application, to produce HTML or HTML and Javascript specific to 
platforms such as WEBTV™, AOLTV™ or other platforms. 
30 Thus, the present invention provides an easy to use, rapid means for developing a 

layout for an enhanced presentation platform, such as a set top box or interactive 
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television, which produces an output platform independent, text based, script file that 
completely defines the assets used (graphics, text, images, and imported executable files), 
including their positions and properties > and timing of their rendering. The platform 
independent nature of iTVML allows a single enhancement file to be created that then 

5 may be parsed to provide platform dependent enhancement files. 

The foregoing description of the invention has been presented for purposes of 
illustration and description. It is not intended to be exhaustive or to limit the invention to 
the precise form disclosed, and other modifications and variations maybe possible in 
light in the above teachings. The embodiment was chosen and described in order to best 

1 o explain the principles of the invention and its practical application to thereby enable 

others skilled in the art to best utilize the invention in various embodiments and various 
modifications as are suited to the particular use contemplated. It is intended that the 
appended claims be construed to include other alternative embodiments of the invention 
except insofar as limited by the. prior art. 

15 
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APPENDIX A - CODE EXAMPLE FOR CLICK & DRAG TO PLACE 
ELEMENTS AND TO RESIZE THEM 

20 Note: Numerical references shewn in bold after V/ 1 relate the section of code to a 

component of the figures. The figures are representative of the actions performed and 
may not reflect the exact order or functions performed. 

25 function mouseDownO //1100 

{ 

//X104: Was che MouaeDown inside of the Divpg (Canvas) ? 

if ( event -x >= divPg .of f setLef t + divMain.of f aetl*ef t 
30 && event, x divPg . of f secLef t - 0 •+ divPg .of f setwidth 

divMain - of f se tLef t 

&& event -y >= divpg. of f setTop + divMain. of f setTop 

event. y <«* divpg.of f setTop - 0 +■ divpg.of f setHeignt + 
divMain.of fsetTop ) 
35 { 

// Yes. 

var el = event- srcElement; 
var pEl = el.parentElement ; 
var i ; 

40 var ieText * false,- 

//H06: Are we positioned inside a knob? 

if (el.id.indexof (* knob", 0) == 0) 
45 { — 

// 1108 Yes, we are on a knob, and the user wants to resize 

the element. 

initlX = event. clientX; 
initlY - event . cliencY; 

50 

knob = el; 
hideKnobs () ; 

MouseDownOnElement = true; 

) . 

55 else //1112 : 

{ 

while (true) 
{ 

if (el-tagName "BODY") return,- 
60 if (pEl.tagName ==» "BODY") retnrn; 

if (pEl.cagName =« "Div && 
pEl . id . indexOf ("divEl") > = 0) break; 

el = pEl; 

pEl el .parencEleraent; 

6$ } 

if (el.tagName == "DIV") 
{ // TEXT AREA 
ob = el. style; 

70 } 

else 
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{ 

ob = pEl. style ; 

} 

75 //Hie 

initlX = event .clientX; 
initlY event .clientY ; 

initlObjX =» ob.posfceft; 
SO initlObjY = ob.posTop; 

eiwidth = el.offsetwidtb; 
elHeight - el .of f setHeight ; 
elName = el. id; 
S5 i = elName. slice (5) ; 

//lllfl: Did the user select a different element ? 
if (elementSelected i) 
{ 

90 MouseDownOnElement = true; 

// 1X20; Change to newly selected element: 
elements elected = i; 
selectElement (i) ; 
hideKnobe ( ) 

95 } ' ■ 

else //1124 

{ 

var updated = true; 

update display with selected* element 
100 if (elementSelected > -1> 

updated = updElc (elementSelected) ; 

} 

105 if (updated) 

{ 

MouseDownOnElement =* true; 

// Change to newly selected element 
110 elementSelected - i; 

eelectElement (i) ; 
hideKnobs ( ) ; 



115 



120 function mou3eMove() //X200 
( 

if (MouseDownOnElement) 
{ 

var fp = window. frmElProps; 
125 var pEl; 

var elType; 

if (knob) //1204 
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{ 

130 var e = eval ("window, ellmg" + elements elected) ; 

elType = parselnt (elements [elementSelected] [eElType] ) ; 

if ( elType kElXsTA ) 

{ 

pEl » e; 

135 e = e. style,- 



} 

else 
{ 



140 } 



pEl - e. parent Element ; 



var delta; 
switch (knob . style . cursor) 

{ 

145 case "w-resize" ; //1210 

{ 

delta a initlX - event . clientX; 
if (elType !=» JcElIsTV) //X212 
{ 

150 if (pEl- style. pixelLeft - delta *<= 



0) //X218 



{ 



delta = pEl . style .pixelbeft ; 
pEl .style .pixelLeft = 0; 



pBl -style .pixelLeft delta; 



155 } 

else 

{ 
} 

160 } 

switch ( elType ) //1214 
{ 

case kElIsGraphic: 
case kElIsBG; 

165 width delta ; 

break ,- 
case kElIsTA: 
e. width = 

Math. abe (parselnt (e. width) + delta) f "px H ; 
170 " break; 

case kElIsTV: //*218 

J / compute available WEST & South 

pixels 

var Wpx = pEl- style .pixelLeft; 
175 var Spx = gCanvasH - 

(pEl.Btyle.pixelTop + e. height) ; 

while ( delta > Wpx { | 

(gCanvasH/ gCanvasW) * delta > Spx ) 

{ 

180 --delca; 

if (delta a= 0) break; 

} 

pEl- style .pixelLefc - = delca; 
e. width += delta; 
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1&5 



190 



195 



200 



205 



210 



215 



220 



225 



230 



235 



240 



(gCanvasH/gCanvasW) ; 



e. height = e. width * 



break ; 
default : > 
break; 



} 



break; 



case "e-resize M : //1220 
{ 



gCanvasW ) 

pEl . style . pixelhef t ; 



delta) ; 
gCanvasW ) 

pEl . style .pixell>ef t; 



var v; 

delta = event -cliencX - initlX; 
switch ( elType ) //X2Z2 

^ case kEHsGraphic: //1224 
case kBHsBG: 

w s= e -width + delta ; 

if ( pEl.style.pixelLeft + w > 



{ 



} 



w b g Canvas W - 



e. width = w; 
break ; 

case kElIsTA: //1224 

vi = Math. abs (par selnt (e .width) + 

if ( pEl. style. pixelLeft + w 



{ 



} 



gCanvasW 



e .width w + n px n ; 
break; 

case kElIsTVr //122S 

// Compute available EAST & South 



pixels 

(pEi. style -pixelLeft + e.width); 
fpEl. style. pixelTop + e. height); 
(gCanvasH/gCanvasW) * delta > Spx ) 



var Epx = gCanvasW - 
var Spx - gCanvasH - 
while ( delta > Epx | 



( 



} 



--delta; 

if (delca 0) toreak; 



(gCanvasH/gCanvaeW) ; 



e- width += delta; 

e. height = e. width ' 



} 

break; 



break; 
default ; 

break ; 
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} 

case "n-resize"; //1230 
{ 

245 var h; 

delta = initlY - event.clientY; 

if (elType 1 = kEHsTV) //1232 
{ 

250 if (pEl . style .pixelTop - delta < 0) 

{ 

delta =■ pEl . style -pixelTop; 
pEl . style .pixelTop = 0; 

255 else 

{ 

pEl. scyle. pixelTop -= delca; 

} 

260 ' ^ 

switch < elType ) //1234 
( 

case JcElIsGraphic: //1238 
case kElIsBG: 

265 e. height delta; 

break ; 

case kElIsTA: //1238 
e - height = 

Math. abs (pars elnt (e. height) + delta) + "px"; 
270 break; 

case kEHsTV: 

// Compute available WORTH & West 

pixels 



275 



285 



290 



295 



(pEl.style.pixelLef t + e. width) ; 
(gCanvasW/gCanvasH)*delta > Wpx ) 



var Wpx « pEl. scyle. pixelTop;; 
var Wpx » gCanvasW - 

while ( delta > Wpx J ) 



280 * --delta; 

if (delta -= o) break; . 

} 

pEl . style .pixelTop - = delta; 
e. height += delta; 
e -width = e. height * 

(gCanvasW/gCanvaeH) ; 

break ; 
defame : 
break; 

} 

break; 
case "e-resize": 

{ 

var h; 

delta * event.clientY - initio,- 
switch ( elType ) //1240 
{ 
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300 



305 



310 



315 



320 



325 



330 



335 



340 



345 



350 



gCanvasH ) 

pEl. style. pixelTop; 



case kElIsGraphic: //X242 
case kElIsBG: . 

h = e. height + delta; 

if { pfel . style. pixel Top + h > 



) 



h * gCanvasH - 



delta) ; 
gCanvasH ) 

pEl - style - pixelTop) ; 



e. height h; 
break ; 

case XElIsTA; //1242 

h « Math* abs (parselnt (e. height) + 

if ( pEl - style .pixelTop + h > 



{ 



} 



h = (gCanvasH 



e. height = h + w px n ; 
break ; 

case kElIsTVz //1246 

// Compute available south & West 



pixel b 

{pEl. style. pixelLeft + e. width) ; 
(pEl . style . pixelTop + e . height) ; 
(gCanvasW/gCanvasH) ~delta > Wpx ) 



(gCanvasW/gCanvaaH) ; 



var Wpx = gCanvasW - 
var Spx - gCanvasH - 
while ( delta > Spx | | 

( 

- -delta ; 

if (delta o) break; 

} 

e. height += delta; 
e . width » e > height * 



breaks- 
default i 

break; 
} // switch ( elType ) 
break; 
} // case s-resize: 

} // switch ( knob -style, curs or ) 

var el = elements [eleraeutSelected] ; //120G 



f p • txtlieft .value 
f p . txtTop .value 
f p . txtwidth - value 

parselnt (e. width) t e. width); 

f p . txtHeight .value 

paroelntfe. height) ; e. height ) ; 
} 



el [eElLef t] 
el teElTop) 
el [eElWidth] 



« pEl - style. pixelLeft; 
= pEl . style. pixelTop; 
^ (elType == JcElXsTA ? 



* el [eElHeight] » (elType == kEHsTA 



355 



if (ob) 
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if (ob.pixelLef c + event .clientX - initlX < 0) 
ob.pixelLef t = 0; 

elee 

360 ob.pixelLeft event . c 11 entx - initlX; 

if ( ob. pi xelLe ft + elWidtb + event . clientX - initlX > 
window, divpg . clientWidth) 

Ob .pixelLef t - window. divpg . clientWidth - elwidtn; 

365 

if (ob.pixelTop + event > clientY - initlY < 0) 
ob-pixelTop = 0; 

else 

ob-pixelTop event . client Y - initlY; 

370 

if (ob.pixelTop + elHeighc + event . clientY - initlY > 
window, divpg . clientHeight ) 

ob.pixelTop ~ window, divpg. cli en cHeight - elHeight; 

375 fp .txtLefc. value » elements [elementSelected] CeElLef t] = 

ob . p ixellief t ; 

fp . txtTop . value = elements [element Select ed] [eElTop] = 

ob.pixelTop; 
} 

380 

initlx » event -clientX ; 
initlY = event .clientY; 

} 

385 return false; 



390 
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390 APPENDIX B 

Appendix B list© an ITVML file generated by the iTVML generator of the 
present invention. Comments are shown becw'een asterisks- The seccion 
showing element information has been edited to reduce the number of 
395 entries . 

** ITVML SETUP AND INTRODUCTORY COMMENTS ** 
<?xml vereion="l. 0"?> 

<!DOCTYPE itvml PUBLIC H -//Intellocity//DTD ITVML 1.0a Dra£t//EN* 
400 "ht tp ; //io . n. 6/dtds/ITVMLl_0a . dcd»> 

<!-- Copyright 2000, 2001 by Intellocity USA, Inc. 
<!-- Viziworx XML Schema 1.3 - -> 

<itvml xmln6= M htcp ;//itvml .org/dtds/lTVKLl_oa.dtd n > 

405 

* * HEAD : DATE PROJECT WAS CREATED, AUTHOR, NOTES, OTHER PROJECT INFO** 
<head> 

<meta name^ n itvmlDateCreated D content- n 200i-08-03T21:47 :36Z w /> 
<meta nameaWprojectAuthor** content = 11 Steve MarJcel»'/> 
410 <meta name« w projectNotes ,r content» B,, /> 

<meta namea'proiectName** content**" sample pages u /> 
<meta name- "project Id" contenta"1389 D /> 

<meta name="projectDateCreated" content="2 001 -07-23T02 : 46r 172*/> 

<meta name^projectExpires*" content a" n /> 
415 <meta name= M projectDateLast Published** content^" "/> * 

<meta name* "pro j ectStatue n contents 11 Development 11 /> 

<meca name= "project Company" content= ,,w /> 

<meta name = " pro jectVideoFileName " content*" n /> 

<meta name^projectTransportABandvidth" contents "4 80 0 tt /> 
420 <meta name- "pro jectTransportAReturnPathBandwidth" content= nn /> 

<meta name= tt projectTransportAReturnPathConnectTime' , content= WM /> 

<meta name^'projectTransportABaseURL" contents" "/> 

</head> 



425 



430 



** LIBRARY: CONTAINS DESCRIPTIONS OF ASSET CONTAINERS (EXTERNAL 
RESOURCES REQUIRED FOR PRESENTING AND ENCODING THE ENHANCED CONTENT) ** 
<library> 
</ library > 



** CONTENT : DESCRIBES EVERY ELEMENT (NAME, TYPE OF ELEMENT, POSITION, -) 
ON EVERY PAGE OF THIS PROJECT* * 

< content canvas ="£40x480" pixelAspect= n l : 1" baseURL= nu > 
435 <page name="actionTestPage»> 

< element name= * tvo " type=*tv w > 

^property name=-action n value™"" /> 

<property narne^ "highlight" value=»crue H /> 
440 <propercy name= ,, top" valuen-O" /> 

<property name- "left" value="0 n /> 

<property name=- "height" value= w 3 90" /> 

<propercy name « "width" value«"520" /> 

<p roper ty name="zOrder w value= "-l** /> 
445 <property name* "visible" value =** true " /> 
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<property name = "color" value= n,, /> 
</elemenc> 

<element naraei u nav" type=" image "> 

^property name="9rc° value^Cr/viziworx/betaGraphica/nav . jpg" /> 

^property names'* act ion" values.* 1 » /> 

<property aame^" highlight n valuen M true" /> 

<property name* rt highlighfcSrc n valuer Mn /> 

<property name^top 1 * valuer 11 0» /> 

<property name= w left n value= n 5l9 t * /> 

<property name= 14 height " value="480 w /> 

<property name= w width ,, value= ,, l2X" /> 

<property nameai I, zOrder H value= M l" /> 

<property name= "visible" value- "true" /> 

<property names * href n value-" n /> 

<property name= h color" valuer" " /> 

</ elements 

< element name="buttonl' t type= w image w > 

<property name^src* value="C;/viziworx/betaGraphics/bufctonl . jpg" /=> 
<property name=" action" value= t,M /> 
<propez-ty namec "highlight fl value» n true n / > 

<properry name^highlightsrc 1 * 

valuer "C: /viziworx/betaGraphlcs/toutton2 . jpg M /:> 

<property name^'cop" value="184 l * /> 

<property names" left' 1 values" 53 6" /> 

<property name ^height" value» r, 20 ,f /> 

<property name- "width" value- "27 " /> 

<property name= n z Order*' value* "4" /> 

<property names "visible" value= " true 11 /> 

<property name= rt href n value= lr " /> 

<property names "col or" value- " u /> 

</elemenx> 

** PROPERTIES OF OTHER ELEMENTS DELETED FOR BREVITY 
<action name= n changeText M > 

<modify-property elements "text area3 » name= "value h value= "New Text i " /> 
</ action> 
</page> 
</ content> 

TIMELINE : TRIGGERS ASSOCIATED WITH EACH PAGE ** 

< timeline lengths "00 ; 00 ; 01 , 00 T frames PerSecond- B 3 0 " 
ntscDropPrame= w crue" .videos t art AtTime= loopNTime3= w l n >< trigger 
name^actionTestTrigger" enabled-" true" pageref = "text " 
startTime= ,, 00 too = 00 .00" accion= n act ionTest Trigger" expires= nn /> 

< trigger name» tt changeText" eDabled= w true" pageref s" text n 
startTime= ,l 00 : 00 :0S . 00" actions "changeText" expires » « w /> 

< trigger name=*visibleFunction** enabled= " true** 
pageref = "act ionTesc Page" startTime- r, 00 :00 : 05 . 00 n actions 
"visibleFunccion" expires- ttn /> 

< / time 1 ine > 



</icvml> 
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Claims 

What is claimed is: 

1 . Method for creating a television enhancement comprising the steps of: 

employing a graphical user interface to position a displayable element; 
specifying or defining a time when said displayable element may be rendered; 
storing information describing said displayable element, and said time. 

2. The method of claim 1 wherein said employing step comprises the steps of: 

defining a window in said graphical user interface; and 
placing said displayable element at a position in said window; 
said method further comprising the steps of: 

employing a database to store said information; 

creating a platform independent television enhancement file containing information 
related to said displayable element, and said time; 

parsing said platform independent television enhancement file to produce an HTML 

file. 

3. The method of claim 2 further comprising the step of viewing said HTML file. 

4. The method of claim 1 wherein in said employing step, said graphical user interface 
positions said displayable element in a position relative to a television image area; and in said 
storing step, said information is associated with said position, and said time in a database; said 
method further comprising the steps of: 

generating an XML file using said information stored in said database; and 
applying an XSL translation to said XML file. 

5. The method of claim 4 further comprising the step: 
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6. The method of claim 4 wherein said user interface further comprises: 

a drag and drop function implemented in a web browser environment that allows said displayable 
element to be positioned in response to signals from a pointing device. 

7. The method of claim 4 wherein said user interface further comprises: 

a resize function implemented in a web browser environment that allows said displayable element to 
be altered in size in response to signals from a pointing device. 

8. The method of claim 2 or 3 wherein said platform independent television enhancement file 
is an XML file. 

9. The method of claim 2 or 3 wherein said step of parsing further comprises: 
applying an XSL transformation to an XML file. 

10. The method of claim 2 or 3 wherein said step of parsing further comprises: 
writing Javascript in said HTML file. 

1 1 . The method of claim 2 further comprising the steps of: 

selecting a video image for enhancement; 

displaying a video window in said window in said graphical user interface; 
parsing said platform independent television enhancement file to produce an HTML file wherein in 
said employing a database step, said stored information also describes said video image, and in said 
creating step, said enhancement file contains information related to said video image. 

12. The method of claim 1 1 further comprising: 
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displaying said HTML file in a web browser containing said video window. 

13. The method of claim 1 1 further comprising: . 
saving said HTML file to said database. 

14. The method of claim 1 1 wherein said step of parsing further comprises: 
applying an XSL transformation to said television enhancement file. 

1 5. The method of claim 1 1 wherein said platform independent television enhancement file is 
an XML file. 

16. The method of claim 2, 3 or 1 1 wherein said step of placing a displayable element further 
comprises: 

employing a software routine, downloaded to a web browser, to locally alter the position of said 
element in response to input from a pointing device. 

17. The method of claim 1 , 2, 3 or 1 1 wherein said displayable element comprises an 
imported HTML file. 

1 8. The method of claim 1 , 2, 3 or 1 1 wherein said step of placing a displayable element 
further comprises: 

employing a software routine, downloaded to a web browser, to locally alter the size of said element 
in response to input from a pointing device. 

19. The method of claim I, 2, 3 or 1 1 wherein said step of placing a displayable element 
further comprises: 



WMj^nnr.in <wo 0P17642A2 I > 



WO 02/17642 



PCT/US01/41894 



defining a z order for said element. 

20. The method of claim 1, 2, 3 or 1 1 wherein said step of placing a displayable element 
further comprises: 

associating a link with said displayable element. 

21 . The method of claim 1 1 wherein said step of parsing further comprises: 
writing Javascript in said HTML file. 

22. The method of claim 2, 3 or 1 1 wherein said window is contained in a web browser. 

23. The method of claim 22 wherein said video window or said window employs a media 
player contained in said web browser. 

24. A system for creating television enhancements comprising: 

a graphical user interface implemented in a web browser environment; 

a rectangular area defined in said browser environment; 

a user interface that places a displayable element in said rectangular area; 

a user interface that specifies a time at which said displayable element may be rendered; 

a database that stores information associated with said displayable element and information 

associated with said time; 

a pointing device; and 

a user interface that initiates generation of an XML file containing tags for said information 
associated with said displayable element and said information associated with said time. 

25. The system of claim 24 wherein said user interface further comprises: 
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a drag and drop function implemented in said web browser environment that allows said displayable 
element to be positioned in response to signals from said pointing device. 



26. The system of claim 24 wherein said user interface for placing a displayable element 
further comprises: 

a resize function implemented in said web browser environment that allows said displayable element 
to be altered in size in response to signals from said pointing device. 

27. The system of claim 24 further comprising: 

a user interface that applies an XSL translation to said XML file to produce an HTML file. 

28. The system of claim 25 further comprising: 

an emulation function operable to display said HTML file on said web browser. 



BNSDOCID: <WO 0217642A2 I > 



30 



WO 02/17642 



PCT/US01/41894 



1/16 



Figure i 



100 



Set Top Box Models 



Mitsubishi WB-2001 
Philips Magnavox MAT972 
Philips Magnavox MAT976 
RCARW2110 
SonyINT-W250 
SonyINT-W200 



HTML Support 



HTML 1.0 
HTML 2.0 
HTML 3.2 

Frames Compatibility 
JavaScript 1.2 



102 



104 



Image Support 



GIF89a animation 
JPEG 

Progressive JPEG 
PNG 

TIFF-G3 Fax in Email 
X bitmap 

Macromedia™ Flash 1 .0 
Macromedia™ Flash 2.0 
Macromedia™ Flash 3.0 
Transaction 



BNSDOCID: <WO 0217642A2_I_> 



SUBSTITUTE SHEET (RULE 26) 



WO 02/17642 



2/16 



PCT/US01/41894 



Figure 2 



200 



Database 




Authoring Program 


Microsoft ADO 




VBScript 


(ActiveX Data Objects) 


< ► 



202 



204 



Display Program 



Javascript 



206 



208 



SUBSTITUTE SHEET (RULE 26) 



BNSDOCID. <WO 0217642A2„L> 



WO 02/17642 



3/16 



PCT/US01/41894 



Figure 3 



Database 



Admin 



Projects 



302 



304 



Pages 



Layout 



306 



308 



Triggers 



310 



300 



Emulate 



Export 



312 



314 



Browser 



SUBSTITUTE SHEET (RULE 26) 



WO 02/17642 



4/16 



PCT/US01/41894 



Figure 4 




SUBSTITUTE SHEET (RULE 26) 



RN.RDODID: <WO 0217642A2 I > 



WO 02/17642 



5/16 



PCT/US01/41894 



Figure 5 
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1 . Method for creating a television enhancement comprising the steps of: 
employing a graphical user interface to position a displayable element; 
specifying or defining a time when said displayable element may be rendered; 
storing, information describing said displayable element, and said time. 

2. The method of claim 1 wherein said employing step comprises the steps of: 
defining a window in said graphical user interface; and 

placing said displayable element at a position in said window; 
said method further comprising the steps of: 

employing a database to store said information; 

creating a platform independent television enhancement file containing 
information related to said displayable element, and said time; 

parsing said platform independent television enhancement file to produce an 
HTML file. 

3. The method of claim 2 further comprising the step of viewing said HTML file. 

. 4. The method of claim 1 wherein in said employing step, said graphical user interface 
positions said displayable element in a position relative to a television image area; and in said 
storing step, said information is associated with said position, and said time in a database; 
said method further comprising the steps of: 

generating an XML file using said information stored in said database; and 

applying an XSL translation to said XML file. 

5. The method of claim 4 further comprising the step: 
specifying a z order for said element. 

6. The method of claim 4 wherein said user interface further comprises: 

a drag and drop function implemented in a web browser that allows said displayable 
element to be positioned in response to signals from a pointing device. 
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7. The method of claim 4 wherein said user interface further comprises: 

a resize function implemented in a web browser environment that allows said 
displayable element to be altered in size in response to signals from a pointing device. 

8. The method of claim 2 or 3 wherein said platform independent television 
enhancement file is an XML file. 

The method of claim 2 or 3 wherein said step of parsing further comprises: 
applying an XSL transformation to an XMIL file. 

The method of claim 2 or 3 wherein said step of parsing further comprises: 
writing Javascript in said HTMIL file. 

The method of claim 2 further comprising the steps of. 
selecting a video image for enhancement; 

displaying a video window in said window in said graphical user interface; 
parsing said platform independent television enhancement file to produce an HTML 
file wherein in said employing a database step, said stored information also describes said 
video image, and in said creating step, said enhancement file contains information related to 
said video image. 

12. The method of claim 1 1 further comprising: 

displaying said HTML file in a web browser containing said video window. 

13. The method of claim 1 1 further comprising: 
saving said HTML file to said database. 

14. The method of claim 1 1 wherein said step of parsing further comprises: 
applying an XSL transformation to said television enhancement file., 

1 5. The method of claim 1 1 wherein said platform independent television enhancement 
file is an XML file. 
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] 6. The method of claim 2 y 3 or 1 1 wherein said step of placing a displayable element 
further comprises: 

employing a software routine, downloaded to a web browser, to locally alter the 
position of said element in response to input from a pointing device. 

1 7. The method of claim 1 , 2, 3 or 1 1 wherein said displayable element comprises an 
imported HTML file. 

1 8. The method of claim 1 ,2, 3 or 1 1 wherein said step of placing a displayable element 
further comprises: . 

employing a software routine, downloaded to a web browser, to locally alter the size 
of said element in response to input from a pointing device. 

1 9. The method of claim 1 , 2, 3 or 1 1 wherein said step of placing a displayable element 
further comprises: 

defining a z order for said element. 

20. The method of claim 1, 2 ? 3 or 1 1 wherein said step of placing a displayable element 
further comprises: 

associating a link with said displayable element. 

21. The method of claim 1 1 wherein said step of parsing further comprises: 
writing Javascript in said HTML file. 

22. The method of claim 2, 3 or 1 1 wherein said window is contained in a web browser. 

23. The method of claim 22 wherein said video window or said window employs a media 
player contained in said web browser. 

24. A system for creating television enhancements comprising: 

a graphical user interface implemented in a web browser environment; 

a rectangular area defined in said browser environment; 

a user interface that places a displayable element in said rectangular area; 

a user interface that specifies a time at which said displayable element may be 

rendered; 
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a database that stores information associated with said displayable element and 
information associated with said time; 
a pointing device; and 

a user interface that initiates generation of an XML file containing tags for said 
information associated with said displayable element and said information associated with 
said time. 

. 25. The system of claim 24 wherein said user interface further comprises: 

a drag and drop function implemented in said web browser environment that allows 
said displayable element to be positioned in response to signals from said pointing device. 

26. The system of claim 24 wherein said user interface for placing a displayable element 
further comprises: 

a resize function implemented in said web browser environment that allows said 
displayable element to be altered in size in response to signals from said pointing device. 

27. The system of claim 24 further comprising: 

a user interface that applies an XSL translation to said XM1L file to produce an 
HTML file. 

28. The system of claim 25 further comprising: 

an emulation function operable to display said HTML file on_said web browser. 

29. A method of creating a television presentation enhancement comprising: 
accessing a browser based authoring package through an administration screen; 
establishing project information for said enhancement; 

defining a window in a graphical user interface contained in a browser; 
placing a displayable element at a position in said window; 
defining a time when said displayable element may be rendered; 
employing a database to store information describing said displayable element, and 
said time; 

creating a platform independent television enhancement file containing information 
related to said displayable element, and said time; 

parsing said platform independent television enhancement file to produce an HTML 
file for a specific television platform; and 

viewing said HTML file. 



34 

AMENDED SHEET (ARTICLE 19) 



DMcnnrin- ,-wn 



WO 02/017642 



PCT/US01/41894 



30. The method of claim 29 wherein said step placing a displayable element further 
comprises; 

employing a software routine, downloaded to said web browser, to locally alter the 
position of said element in response to input from a pointing device. 

31 . The method of Claim 29 wherein said element comprises an imported HTML file. 

32. The method of claim 29 wherein said step placing a displayable element further 
comprises: 

employing a software routine, downloaded to said web browser, to locally alter the 
size of said element in response to input from a pointing device. 

33. The method of claim 29 wherein said step of placing a displayable element further 
comprises: 

defining a z order for said element. 

34. The method of Claim 29 wherein said step of placing a displayable element further 
comprises: 

associating a link with said displayable element. 

35. The method of Claim 29 wherein said platform independent television enhancement 
file is an XML file. 



f 36. The method of Claim 29 wherein said step of parsing further comprises: 
applying an XSL transformation to an XML file. 

37. The method of Claim 28 wherein said step of parsing further comprises: 
writing Javascript in said HTML file. 



38. The method of claim 29 further comprising: 

emulating said enhancement in said browser window prior to saving said 
enhancement file. 



39. The method of claim 29 further comprising: 

employing a change attribute function to alter an attribute of a previously defined 
element. 
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40. The method of claim 29 wherein said project information comprises a client name. 

41 . The method of claim 29 wherein said project information comprises an identifier of a 
video file. 

42. The method of claim 29 wherein said project information comprises a file to which 
said enhancement may be published 

43 . A method for creating a television presentation enhancement comprising: 
selecting a video image for enhancement; 

defining a window in a graphical user interface contained in a web browser; 
displaying a video window in said window in said graphical user interface; 
placing a displayable element at a position in said window in said graphical user 
interface; 

defining a time when said displayable element may be rendered; 

employing a database to store information describing said video image, said 
displayable element, and said time; 

creating a platform independent television enhancement file containing information 
related to said video image, said displayable element, and said time; and 

parsing said platform independent television enhancement file to produce an HTML 
file for a specific television platform. 

44. The method of claim 43 further comprising: 

displaying said HTML file in a web browser containing said video window. 

45. The method of claim 43 further comprising: 
saving said HTML file to said database. 

46. The method of claim 43 wherein said step of parsing further comprises: 

applying an XSL transformation to said television enhancement file to 
produce a television platform specific file. 

47. The method of claim 43 wherein said platform independent television enhancement 
file is an XML file. 



36 

AMENDED SHEET (ARTICLE 19) 



WO 02/017642 



PCT/US01/41894 



48. The method of claim 43 wherein said step placing a displayable element further 
comprises: 

employing a software routine, downloaded to said web browser, to locally alter the 
position of said element in response to input from a pointing device. 

49. The method of claim 43 wherein said displayable element comprises an imported 
HTML file. 

50. The method of claim 43 wherein said step placing a displayable element farther 
comprises: 

employing a software routine, downloaded to said web browser, to locally alter the 
size of said element in response to input from a pointing device. 

51 . The method of claim 43 wherein said step of placing a displayable element further 
comprises: 

defining a z order for said element. 

52. The method of claim 43 wherein said step of placing a displayable element further 
comprises: 

associating a link with said displayable element. 

53. The method of claim 43 wherein said step of parsing further comprises: 
writing Javascript in said HTML file. 

54. The method of claim 43 further comprising: 

emulating said enhancement in said browser window prior to saving said 
enhancement file. 

55. The method of claim 43 further comprising: 

employing a change attribute function to alter an attribute of a previously defined 
element. 



A system for creating television enhancements comprising: 

a project interface that contains project information for said enhancements; 

a graphical user interface implemented in a browser environment; 

a rectangular area defined in said browser environment; 

a user interface that places a displayable element in said rectangular area; 
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a user interface that specifies a time at which said displayable element may be 
rendered; 

a database that stores information associated with said displayable element and 
information associated with said time; 

a user interface that allows an attribute of said displayable element to be changed at a 
specified time; 

a pointing device; 

a user interface that initiates generation of an XML file containing tags for said 
information associated with said displayable element and said information associated with 
said time; and 

a parsing program that produces an output file for a specific television platform. 

57. The system of claim 56 wherein said user interface further comprises: 

a drag and drop function implemented locally in said browser environment that allows 
said displayable element to be positioned in response to signals from said pointing device. 

58. The system of claim 56 wherein said user interface for placing a displayable element 
further comprises: 

a resize function implemented locally in said browser environment that allows said 
displayable element to be altered in size in response to signals from said pointing device. 

59. The system of claim 56 further comprising: 

a user interface for that applies an XSL translation to said XML file to produce an 
HTML file for a specific television platform. 

60. The system of claim 57 further comprising: 

an emulation function operable to display said HTML file and a television image in 
said browser prior to saving said HTML file. 

61 . A television enhancement file generated by the steps of: 

employing a browser accessed graphical user interface to position a displayable 
element in a position relative to a television image area in a browser window; 

specifying a time at which said displayable element may be rendered; 

storing information associated with said displayable element, said information 
associated with said position, and said time in a database; 

generating an XML file using said information stored in said database; and 

applying an XSL translation to. said XML file to produce a television platform 
specific file. 
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62. 



The television enhancement file of claim 61 further comprising the step: 
specifying a z order for said element. 



63. The television enhancement file of claim 61 wherein said user interface further 

comprises: 

a drag and drop function implemented locally in said browser environment that allows 
said d,s P Iayab]e element to be positioned in response to signals from a pointing device. 



64. 



comprises 



The television enhancement file of claim 61 wherein said user interface further 



a resize function implemented locally in said browser environment that allows said 
displayable element to be altered in size in response to signals from a pointing device. 

65. A web based television enhancement authoring program that operates in a web 
browser comprising: 

an administration screen providing user access; 
a projects screen containing project information; 

a database screen providing storage and retrieval of enhancement projects; 

a layout screen that provides selection, placement, and resizing of displayable 
elements, that provides changing of an attribute associated with a displayable element and 
that mcludes a drag and drop function and a resizing function implemented locally in said 

web browser; 

a triggers screen that synchronizes rendering of an enhancement with an event- 

an emulation screen that provides display of said enhancement and a video image in 

said browser window prior to saving said enhancement; and 

a parsing module that parses a platform independent enhancement file to produce an 

enhancement file for a specific television platform. 
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